Using relaxational dynamics to reduce network congestion 
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Abstract 

We study the effects of relaxational dynamics on congestion pressure in scale free networks by 
analyzing the properties of the corresponding gradient networks [lj] . Using the Family model 2j 
from surface-growth physics as single-step load-balancing dynamics, we show that the congestion 
pressure considerably drops on scale-free networks when compared with the same dynamics on 
random graphs. This is due to a structural transition of the corresponding gradient network 
clusters, which self-organize such as to reduce the congestion pressure. This reduction is enhanced 
when lowering the value of the connectivity exponent A towards 2. 

PACS numbers: 89.75.Hc,05.60.Cd,05.60.-k,05.10.Gg 
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Transport networks, such as computer networks (Internet), airways, energy transporta- 
tion networks, etc., are amongst the most vital components of modern day infrastructures. 
These large-scale networks have not been globally designed, instead they are the result of 
local processes. It has been observed that many networks have a scale-free (SF) connectivity 
structure 0, Q]. Scale- free networks are characterized by a power-law degree distribution 
P{k) ~ k~ x , {k > k m in), where A is the connectivity exponent and k m i n is the lower degree 
that a node can have. There have been a number of mechanisms proposed in the form 
of stochastic network growth models that produce SF structures |j] including weighted 
versions of these processes |5| (for discussions on the utility of SF models see Ref. 6]). How- 
ever, these models do not explicitly connect the flow dynamics and transport performance 
(such as throughput, queuing characteristics, etc.) with network topology. This is difficult 
to do in general, since the time-scales of the flow on the network and that of the network's 
structural evolution itself can be rather different. 

In this Letter we show that the emergence of scale-free structures is favored against non- 
scale-free structures, such as random graphs, if the transport dynamics has a relaxation 
component (called load-balancing in communications). We will see that even one step of 
such a gradient flow jl| will considerably reduce the congestion pressure in scale-free networks 
while it has virtually no effect in random graphs. In addition, within the class of uncorrelated 
scale-free networks, the congestion reduction is enhanced for low (close to 2) A values. 
Although we use the jargon from the fields of communication networks and queuing theory, 
we expect that our results hold for large-scale networks in general, where the flow dynamics 
is induced at least in part by the existence of gradients, a rather ubiquitous mechanism. In 
the following, by "packet" we mean any discrete entity transported between two nodes of 
a network of iV nodes. We assume that the network is driven in "the volume", by packets 
entering at random at an average rate 7 at any of the nodes (this is realistic since the users 
actions in general are uncorrelated) . Using the language of queuing theory, if a 

node in the time interval (t, t + r) sends packets into the network, but it receives no packets 
from any of its neighbors, we say that it acts as a "client", while if it receives a packet 



or several more from its neighbors, we say that it acts as a "server" Here r > is 

the average processing time of a single packet by a node. Measuring the average fraction 
J = (N c /N) of the number of clients N c (over a period of time in the steady state), gives us 
a simple global measure for the congestion pressure present in the network The average 
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(•) is over the randomness in the input but it can also be over network structure when 
comparing classes of networks. The client nodes are the ones that introduce new packets 
into the network, but they do not contribute to routing. Obviously, higher J means more 
congestion. Certainly, a 
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1 networks will become congested at large enough driving rates 
131 ] . J indicates which network will become congested earlier, larger 
J meaning smaller j c . J is a global indicator that, however, does not take into account the 
distribution of the packets over the server nodes. That can be done via betweenness-based 



quantities as in Ref. 141 . Load-balancing is a specific case of the more general process of 



gradients induced flows where the flows are produced by the local gradients of a non- 
degenerate scalar field h = {h,i}f =l distributed over the N nodes of a substrate graph G 
(transport network). The scalar field could represent, for example, the number of packets 



at the routers 15|, [16( , or the virtual time horizon of the processors in parallel discrete event 
simulations lj. The gradient direction of a node i is a directed edge pointing towards 
that neighbor (on G) j of i which has the lowest value of the scalar in z-s neighborhood. 
If i has the lowest value of h in its network neighborhood, the gradient link is a self-loop. 
The gradient network V^G is defined simply as the collection of all gradient edges on the 
substrate graph G [LQ]- It represents the subgraph of instantaneous maximum flow if the 
flow is induced by these gradients. In the gradient network each node has a unique outgoing 
link and I incoming links. When a node has i = 0, (no inflow in that instant), it acts as a 
client, otherwise it is a server. Then certainly, J is the average fraction of nodes, with i = 0, 
i.e., it is the fraction of the "leaves" of VhG. Note that J is a queuing characteristic, rather 
than an actual throughput measure. It was shown l], [lsl that distributing random scalars 
{h} independently onto the nodes of a network G, to which we refer as the static (S) model 
in the remainder, Erdos-Renyi (ER) graphs [li| (with given link probability p) become more 
congested with increasing network size N, i.e., J$ — > 1 while on SF networks J$ converges to 
a finite sub-unitary value, see the plots for J$ in Fig. [D Once the (gradient) flow commences 
through the network, the scalar field becomes correlated and the queuing characteristics 
change. Usually, packets have destinations, and thus they cannot be governed exclusively 
by gradient flows, however, relaxational dynamics can be employed for finite periods of 
time. In the following we systematically study the effects of a single relaxational step, and 
show, that even in this case, the effects on congestion pressure can be drastic. First, we 
note that the one-step relaxation dynamics defined by the gradient flow is nothing but the 
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FIG. 1: Js and Jr as function of N for SF networks with different values of A, 2.5 (0)> 3(o), 3.5 
(□), with filled symbols for S and empty symbols for R. In the inset we plot Js, (CO) an< ^ JRi C— D> 
as function of N for ER networks (p = 0.1). 



deposition model with surface relaxation (Family model) [2| from surface-growth physics 



extended to networks 
with k mi „ = 



20|. To generate SF networks, we used the configurational model 21] 



22i | (mostly for mathematical convenience, but see the discussion in the end 



about other networks). At t = a random scalar field h is constructed by assigning to each 
node of the substrate network a random scalar independently and uniformly distributed 
between and 1. At this stage the initial static gradient network [jj is formed and its 
jamming coefficient Jq determined. Then the scalars h = h(t) are evolved obeying the rules 
of the Family model 2j: at every time step a node % of the substrate is chosen at random 
with probability 1/N and it becomes a candidate for growth. If hi < hj for every j (gradient 
criterion) which is a nearest neighbor of the node i, hi — > hi + 1. Otherwise, if hi is not a 
minimum, the node j with minimum h is incremented by one. When the process reaches 



the steady state 



201 ] of the evolution with this relaxation (R), we construct the gradient 



20 



23(, the steady 



network and measure Jr. In accordance with previous observations 
state is reached extremely fast: the saturation time actually does not scale with the system 
size N but it approaches an iV-independent constant. In Fig. [T] we plot J$ and Jr as 
function of N for ER graphs and for SF networks (for the latter we compare cases with 
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FIG. 2: Plot of II, O for R and □ for S, for SF networks as function of A (N = 4000). 

different A values). As one can observe (inset), for ER networks, the model with relaxation 
has no effect on lowering the congestion, i.e., Js — Jr- For SF networks, however, there 
is a drastic difference between the static and dynamic cases, with Js being considerably 
larger than Jr for large enough N. Note that J$ increases with decreasing A, which can be 
understood through the fact that for lower A values the V^G of the SF graph is increasingly 
star-like, creating more congestion (see below). Since in real- world networks, however, one 
expects to find a load-balancing component of the transmission dynamics (see [jjj]), our 
model with relaxation is a better representation than the static one. And indeed, from Fig. 
[1] it becomes apparent that Jr has the opposite behavior as function of A for large enough 
networks: lowering A lowers the congestion pressure Jr. Next we show how the drop in the 
congestion pressure due to relaxation dynamics can be understood in terms of a structural 
change of the clusters of the corresponding gradient network. Here the clusters are defined as 
the disconnected components (trees) of the gradient graph. The decrease of Jr (which is the 
fraction of leaves of the gradient network) means a decrease of the perimeter of the clusters 
of VhG. To simplify the discussion, in the following we will use the symbol II to denote 
the fraction of leaves (or the perimeter) of V^G, and thus II = Js ot r- In Fig. [2] we show II 
as function of A for a fixed network size N . From this we can see that for a given value of 
N, IT is larger for the S model than the R one. This is compatible with a transition on the 
structure of the trees of the gradient network from a star-like structure in the S state to a 
more elongated structure in the R, see Fig. [3j This transition is responsible for the drop in 
the congestion pressure after the relaxation step is applied. From Fig. [3] we can see that for 
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the ER networks the R model does not affect significantly the structure of the clusters of the 
gradient network (going from Fig. [3^) to b)), meanwhile, for SF networks (going from Fig. 
[3b) to d)) we observe a major structural transition before and after the relaxation dynamics 
is applied, from a star-like cluster to an elongated one. For a quantitative insight of the S 




c) X d) 



FIG. 3: Largest clusters of the gradient networks of ER and SF with A = 2.5 and N = 1024. In 
the top plots, we show the structure for the ER and on the bottom for SF. The left plots (a),c)) 
correspond to the S and the right ones (b), d)) to the R models. 

model consider that the scalars are identically (and independently) distributed according to 
some distribution rj(h). For the calculations below we assume that the SF network has low 
clustering, i.e., that the probability of two neighbors of a node to be also neighbors is small. 
Assume that the central node i has its scalar value equal to hi. Then, the probability that 
the neighbor j of i points its gradient link (given hi) into i equals to: 

Pj^i , = / 



dh' rj(h') 



[0(^)P' , (1) 



where <j){x) = f dh rj{h) and rrij is the degree of node j. This is because the scalars at all 
the rrij — 1 neighbors of j (that do not include i) must be larger than /ij, and in addition 
we also have to have hj > hi. Hence the probability that node j does not point its gradient 
link into % is (1 — Pj-,i\ h .)• In order for node i to be a leaf on the gradient tree, one must 
have that none of its neighbors point their gradient directions into it. This is given by: 
rL'Li(l — Pj->i\hi)' where for simplicity we labelled the neighbors of i by j = 1, 2, . . . , ki. 
Thus, the probability that i is a leaf is expressed by: 7Tj = f^dhi r](hi) Yl'jLxfi ~ Pj^h,)- 
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-dh r](h), the integral becomes: 



Using ([T]) and the change of variable from h to 

#TT(1 -0 m O . (2) 

7=1 

This expression shows that among all nodes i with the same degree k, those will likely 
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FIG. 4: Linear-log plot of (£(k)) as function of k with A = 2.5 and TV = 1024 for S (O), and R 
(□), for t = 0.1 and R (A) in the steady state. As the system evolves, (£(k)) loses its dependence 
on k. We show the plot in the lin-log scale in order to be able to visualize them in the same figure. 

be leaves in V^G, which have neighbors with high degree. It also shows that hubs will 
have very low probability of becoming leaves since in that case many (k) sub-unitary values 
are multiplied in Eq. (T2]). Therefore, leaves are coming from the set of nodes with low, 
or moderate degrees, connected to hubs, supporting Fig. [3b). When there is relaxation, 
the leaves are sending their load towards higher degree nodes (on average), correlating 
the scalars with the degree. This increases the chance of larger degree nodes to become 
leaves and breaking the star-like structures. As a consequence, the gradient network makes 
a transition to more elongated clusters, reducing its perimeter, and thus the congestion 
pressure. To support our claims numerically, we computed the average in-degree (£(k)) of 
VhG as function of k in both the S and the R models. In the S model the gradient clusters 
are star-like, and thus they are very heterogeneous, which appears as a strong dependence 
of (£{k)) on k, see the circles in Fig. HI After relaxation, however, this heterogeneity almost 
disappears (squares and triangles in Fig. H]), and in the steady state, (£{k)) ~ 1 (only a weak 
^-dependence remains), which means that VhG is made of elongated, homogenous trees. 
Defining the relative improvement factor as F(N) = Js/Jr, which measures how efficient 
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FIG. 5: a) F(JV) as function of N, for SF networks with A = 2.5 (O), 3.0 (A), 3.5 (*) and for ER 
networks with p = 0.1 (+). The dashed lines correspond to the logarithmic fit of F(N) as function 
of N in the asymptotic regime (see also inset), b) Asymptotic improvement factor as function of 
the connectivity exponent. 



is the relaxation dynamics in reducing the congestion [24[, we find that for SF networks, 
as A decreases, F(N) increases, see Fig. [5k), where we plot F(N) as function of N for 
different values of A. In addition, from Fig. EK), we observe that F(N) has a logarithmic 
convergence to its asymptotic value, i.e., F(N) ~ F(oo) — K/hxN (with K as a constant), 
see also the inset of Fig. [5^). Fig. \5jp) shows the infinite-system size relative improvement 
factor as function of A, showing the increasing power of the relaxation mechanism for lower 
A values. The effects shown here seem to hold for other SF networks that we tested as well, 
including real- world networks such as the DIMES Internet mapping project generated AS 
level network (www.netdimes.org). The DIMES network is a correlated SF graph, and there 
the relaxation dynamics improves the congestion pressure drastically: from a Js = 0.61 the 
congestion pressure drops to Jr = 0.18! This suggests that topology correlations play an 
important role which are the subject of present studies. 
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